Worksheet 1: Working with One Dimensional Data

This worksheet covers concepts covered in the first half of Module 1 - Exploratory Data Analysis in One Dimension.

There are many ways to accomplish the tasks that you are presented with, however you will find that by using the techniques covered in class, the exercises should be relatively simple.

Import the Libraries

For this exercise, we will be using:

• Pandas (http://pandas.pydata.org/pandas-docs/stable/)
• Numpy (https://docs.scipy.org/doc/numpy/reference/)
• Matplotlib (http://matplotlib.org/api/pyplot_api.html)

Exercise 1: Splitting and Filtering a Series

In this exercise, you are given a list of email addresses called emails. Your goal is to find the email accounts from domains that end in .edu. To accomplish this, you will need to:

1. Filter the series to remove the emails that do not end in .edu
2. Extract the accounts.

If you get stuck, refer to the documentation for Pandas string manipulation (http://pandas.pydata.org/pandas-docs/stable/text.html) or the slides. Note that there are various functions to accomplish this task.

Exercise 2: Applying a Function

In this exercise you are given a list of weights in pounds and a function to convert the measures into kilograms. For this exercise, apply the conversion function to the original series and convert the measures into kilograms.

Exercise 3: Putting it all together

You are given a Series of IP Addresses and the goal is to limit this data to private IP addresses. Python has an ipaddress module which provides the capability to create, manipulate and operate on IPv4 and IPv6 addresses and networks. Complete documentation is available here: https://docs.python.org/3/library/ipaddress.html.

Here are some examples of how you might use this module:

import ipaddress
myIP = ipaddress.ip_address( '192.168.0.1' )
myNetwork = ipaddress.ip_network( '192.168.0.0/28' )

#Check membership in network
if myIP in myNetwork:  #This works
    print "Yay!"

#Loop through CIDR blocks
for ip in myNetwork:
    print( ip )

192.168.0.0
192.168.0.1
…
…
192.168.0.13
192.168.0.14
192.168.0.15

#Testing to see if an IP is private
if myIP.is_private:
    print( "This IP is private" )
else:
    print( "Routable IP" )

1. First, write a function which takes an IP address and returns true if the IP is private, false if it is public. HINT: use the ipaddress module.
2. Next, use this to create a Series of true/false values in the same sequence as your original Series.
3. Finally, use this to filter out the original Series so that it contains only private IP addresses.